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The psychophysical study reported herein was performed 
by the National Photographic Interpretation Center (NPIC), 
with the support of Human Factors Research, Inc. , in response 
to a request levied by the Office of Special Projects, NDDSGT. 
It was conducted to compare the best examples of domestic 
KI-8 coverage with various quality simulated Zaman (electro- 


optical) imagery . 


The simulated imagery consisted of com- 


binations of different ground sample distances (GSU) and 


Signal-to-noise ratios (SNR). 


The objective of the study 


was to determine what combinations of GSD and SNR constitute 
electro-optical images approximately equivalent for exploi- 
tation purposes to the "best quality'' KH-8 photography. 
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II. METHOD 


It was not possible, because of time constraints and 
the few scenes available, to obtain objective measures of 
photo interpreter (PI) performance with the imagery. Conse- 
quently, the psychophysical technique of ranking was used. 
This technique had been shown in previous studics conducted 
at NPIC to be very reliable.! A major assumption in these 
previous studics as well as in the current investigation is 
that ranking of images by professional PIs reflects the 
exploitation potential of those images. 


The Imagery 


Three domestic scenes, a concrete pipe plant (Scene A), 
an engineering test center (Scene B), and an airfield (Scene C) 
were used in this experiment (see Attachment A). ‘There were 
eight images of cach of the three scenes: two "best quality’ 


Ni-8 and six sinulated Zaman images. The six simulated images 
represented three values of a] 12"; and txo 
values of SNR, 5:1 and 3:1. ‘Thus, there was a simulated image 
representing each of the six cells illustrated by ‘lable 1. 


It was assumed that the GSDs and SNRs describing the simulated 
Zaman imagery were accurate representations of those parameters. 


Table 1, SIMULATED ZAMAN IMAGERY CHARACTERISTICS 


Ground Sample Distance 


Sipnal -to- 
Noise Ratio | 5: 


i 
1 


lpuckner, Ilarabedian, and Scott, The Judged Worth of 
Aerial Photography as a Function of Obliguity Angle with 
Scale Constant, ithman Factors Research, Inc., Technical 
Report 723-4, April 1967. 
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Two sets of the simulated images were used in the 
Study. ‘the characteristics of these images, applicable to 
all three scenes, are shown in Table 2. One set of positive 
transparencies was contact printed from the original simulated 
images (as produced by the Perkin-Elmer Line Scan Image 
Generator). The scale of these images increased directly as 
a function of decreasing GSD. The images representing a GSD 


Square and covered the same area on the ground. The inages 
representing a GSU of 12" were approximately 4 1/2" square 
and also covered the same area on the ground (see Attachment C). 


Table 2. Characteristics of the Simulated 
Imagery and NI-8 Photography 


BYEMAN 
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| 
| Ground 
Sample Approximate Ground 
| Distance Signal -to- Approximate Format Size Coverage 
(Inches) Noise Ratio (Inches Square) |(Ft. Square 
| ZAMAN 
: ZAMAN 
| ZAMAN 
| ZADIAN 
| ZAMAN 
| ZAMAN 
| ZAMAN : 1/5000 
| ZAMAN : 1/5000 
. ZAMAN : 1/5000 
| ZAMAN : 1/5000 
: | 1/5000 
4 1/5000 
) KH8 (2430) 1/35000 
K8 (S0369) 1/35000 
| *Only the sam covered by the Zaman imagery was used 
in the comp HT Handle Via 
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_ The second set of simulated images also consisted of 
positive transparencies, but each image had been reduced from 
the original simulated image to make the scales approximately 


eq ‘ach waS approximately 0.6'' square and covered the 
same Square area on the ground. 


The two KH-8 images of each scene were also positive 
transparencies which had been contact printed from the original 
negative. These negatives were previously selected by NPIC as 
representing "best quality" KiI-8 photography (See Attachment D). 


One of these transparencies was duplicated on lastman 
kodak Fine Grain Aerial Duplicating Film (2430), the standard 
duplicating material used for NPIC exploitation. The other 
transparency was duplicated on Eastman Kodak Recordak Print 
Film (SO0-369), which is a higher contrast material than 2430 
and is used in special exploitation situations at NPIC. The 
NI-8 images were contact scale and different from the scales 
of either of the two sets of simulated imagery, as is also 
shown in Table 2. 


Two other types of stimulus materials were also furnished, 
but not used in this experiment. One was a third contact print 
of the KII-8 imagery printed on Lastman Kodak Recordak Minicard 
Film (6451), which is a very high contrast duplicating material. 
This. material was not used because it was judged to be of too 
high contrast for the particular scenes being used. 


The second type of material consisted of two groups of 
7X enlargements of the three KI-8 scenes printed on Lastman 
kodak Fine Grain Positive Film (7302). The two groups differed 
in that they had been produced on different enlarging equipnent, 
one group on the Eastman Kodak Beacon Precision Lnlarger (BPE) 
and the other on the Saltzman Enlarger. The rationale for 
producing these materials was to use them in the comparison 
tests with the reduced scale simulated material, tests in which 
both the KH-8 and simulated Zaman imagery would be of equal 
scale (both 1/5000). 


The 7X enlargements from the BPE enlarger showed frequent 
minus density spots resulting from the matte particles of the 
original negative. Because of these spots, Eastman kodak also 
sent 7X enlargements made on a Saltzman Enlarger. These 
enlargements did not contain the spots, but were not of optimum 
image quality. The NPIC photographic laboratory also attempted 
to reproduce the 7X enlargements on their BPE, but they 
were equally unsuccessful in eliminating the effect of the 
matte particles. 
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Because of the potential bias introduced by the 
presence of the spots on the BPL enlargements and inadequate 
quality of the Saltzman enlargements, none of the 7X enlarged 
matcrial was used in the experiment. 


Although the NJ-8 and simulated Zaman imagery covered 
the same ground areas, the scene content varied slightly 
because of the differing acquisition times. As a consequence, 
the length and orientation of the shadows in the HII-8 images 
were different from those in the simulated imagery and certain 
other features of each scene were also changed. For example 
in Scene A, cranes and trucks had been moved in the period 
between the two acquisition flights, but many of the features 
from which "worth for intelligence purposes!’ could be judged 
had not changed. 


Experimental Design _ 


The subjects were asked to rank the eight images of each 
scene in terms of their "worth for intelligence purposes." 
After they had ranked the eight images of one scene, they were 
asked to rank the images of a second scene, and finally the 
remaining scene. 


In each case the subjects first ranked the six simulated 
images of one scene. Then they incorporated the NI-8 photography 
into the ranks they had assigned to the six simulated images of 
the scene. 


All 26 subjects ranked all of the images of each scene. 
Nalf of the subjects ranked the reduced (1/5000) scale simulated 
images (Zaman Set 2) and the Ni-8 images first, and then after 
a time interval of about a day, they ranked the contact scale 
Simulated images (Zaman Set 1) and the KMI-8 images. ‘Ihe other 
half of the subjects ranked the contact scale sinulated images 
and the NI-8 images first and then after a similar interval 
ranked the reduced scale simulated images and the NI-8 images. 
In like marmer, the scenes were presented systematically to 
the subject so that each scene appeared either first, second, 
or third equally often. These procedures were designed to 
reduce any order effects such as learning or fatigue. 


fy 


‘The Subjects 


‘iwenty-six employees of NPIC participated in the study. 
‘lwenty-one were professional photo interpreters working in the 
Imagery Exploitation Group (ING). ‘These 21 PIs represented 
both CIA and DIA. They had from two to 29 years of experience 
in photo interpretation, and at the time the study was 
conducted, all were active PIs. The other five subjects were 
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technologists of the Applied Photo Science Division (APSD) 
of the Technical Services Group (TSG), and they had from two 
to 15 years of experience in evaluating photographic image 


quality. 
The Equipment 


The subjects used a Richards 940 Split-Format Light 
Table and a Bausch and Lomb (B&L) zoom microscope to evaluate 
the imagery. The subjects did not use the microscope to 
evaluate the contact scale simulated imagery; however, they 
did use it to evaluate the reduced scale simulated imagery 
and the KH-8 photography. B&L 7X tube magnifiers were also 
used, 


The Procedure 


The subjects were instructed informally how they should 
evaluate the imagery. First they were told: 


"You have been asked to participate in a 
study designed to determine the relative worth 
or usefulness for intelligence purposes of two 
types of imagery, The study is being done for 
the Office of Special Projects in CIA. 


"The results of the study may possibly have 
significant implications for the design of future 
reconnaissance systems. So, it is important that 
in making your comparisons of the different 
images you consider all of the relevant factors 
that make one image better than another for 
intelligence purposes, 


‘When I say ‘worth or usefulness for intelli- 
gence purposes,' I mean the interpretability or 
informative value of the images in light of the 


requirements levied on you and the questions 


asked you by the intelligence analysts. 


"We have two types of images of three scenes. 
One type you will recognize immediately as being 
KH-8 material. We have two KH-8 images of cach 
of the three scenes, I will give you the six 
experimental images of one scene first. I want 
you first to look carefully at all of them, and 
then rank them from best to worst, After you 
have done that, I will give you two KH-8 images 
of the same scene, and I want you to rank them 
along with the six experimental images. 
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"In making your evaluations look at those 
parts of the scene that you normally look at 
when you evaluate mission photography. Look, 
for example, 


and so on. In addition, use other features that 
you normally use. 


"The original negatives from which the experi- 
mental and the KH-8 imagery was made were obtained 
at different times, | 
are different, as are the scales. 
Please try to ignore these differences and concen- 
trate on the informative value of the imagery, its 
informative value in light of the requirements 
levied on you. 


"T will give you the six experimental images 
of one scene first and after you have ranked them 
I'll give you the two KH-8 images of the same scene. 
After you complete that I'll give you the images 
of the second scene. 


"Rank the scenes on this Response Sheet [see 
Attachment E] with the number-letter designation of 
the best image at the top, the worst at the bottom, 
and rest of them somewhere in between. 


"Take your time; take breaks if you wish, And 
don't hesitate to ask questions. Do you have any 
questions now? 


The subjects took about an hour and 15 minutes to evaluate 
the reduced scale simulated and Ki-8 photography of all three 
scenes. They used the microscopes to evaluate both types of 


imagery. 


They took about an hour to evaluate the contact scale simu- 
lated and KH-8 photography of all three scenes. Again, they used 
the microscopes to evaluate the KH-8 imagery, but in most instances 
could evaluate the large scale simulated imagery without using any 
magnification. 


After the subjectshad ranked the simulated and KII-8 images 
of all three scenes, they ranked the three KH-8 images printed on 
2430 and the three KH-8 photographs printed on SO-369 to determine 
whether a significant image quality difference existed between the 
three KH-8 scenes. If such a difference existed, there is a possi- 
bility that it could produce variability from scene to scene in the 
position of the KH-8 imagery with respect to the Zaman simulated 
imagery rank. 
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III. RESULTS 


The means and standard deviations of the ranks assigned the 
images by the five photographic scientists were compared with the means 
and standard deviations of the ranks assigned the images by the 21 PIs. 
There were no significant differences, so the data from the two groups 
were combined for presentation here. 


The means and standard deviations of the rankings made by the 
13 subjects who ranked the reduced scale simulated images first were 
compared with the means and standard deviations of the rankings made by 
the 13 subjects who ranked the reduced scale images second. The 
differences between the means and the standard deviations were not 
Significant, so the data obtained from the two orders of presentation 
of the images were combined. 


The rankings of the contact and reduced scale images in relation 
to the KH-8 images are presented separately, because in spite of the 
lack of statistically significant differences, there were differences 
in the mean ranks, — 


All of the data from which summary statistics were computed are 
shown in Attachment F, so that the reader may make comparisons and 
computations not presented. 


Table 3 is a summary of the data. The means and standard 
deviations of the judgments of all subjects of the contact scale and 
reduced scale simulated imagery in relation to the two types of KH-8 
imagery are shown. 


Table 4 and Figures 1 and 2 (pages 12 to 29) below describe the 
data for each scene and both scales. The table shows the combined raw 
data. The numbers in the table indicate the frequencies of the rank 
assignments. Figure 1 shows the means and standard deviations of the 
data shown in Table 4. Figure 2 consists of a graph with number of ob- 
servations plotted on the vertical axis and rank position plotted on the 
horizontal axis. The simulated Zaman imagery was first plotted in rank 
position, one through six, and represented by vertical bars. The height 


of the bars signifies the number of observers who ranked the 


and so 
on. This would be the logical ranking of the simulated Zaman imagery if 
the technologist examined only the engineering parameters, ground sample 
distance and signal to noise ratio, assuming that the predominant 
differences among the six simulated image scenes are controlled by GSD 
rather than SNR. That is, in the simulated Zaman imagery provided, the 
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TABLE 3 Means and Standard Deviations of Ranks of the 
Three Scenes - Reduced and Contact Scale Simulated 
Images, 


REDUCED SCALE 


12/521!" 120/533; 
7.11 | 7.73 | 
0.58 | 0.52 | 


Way) eee Un Cay re 
7.34 | 7.50 
0.68 | 0.87 


Le 3b 
7s is 7.73 
0.44 


CONTACT SCALE 


12"/5:] 12°'/3:1 
6.88 7.85 
0.64 0.45 


12"/5:1|_ 12'/3; 1) 


7.19 7.40." 
0.68 | 0.69 | 


12"/5:1| 
| 


Ips: ui 
“7.35 7.55. 5 
0.68 0. 50 


The image identification. The number to the 
left of the slant-line is the GSD in inches; 
the number to the right shows the SNR. The 
numbers, 2430 and 369 identify the two KH-8 
images. 


The mean of the ranks assigned the image. 
The standard deviation of the ranks assigned 


the image. 
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changes in ground sample distance contributed more to differences in - 
image quality than did the changes in signal-to-noise ratio within 
one ground sample distance. This assumption is verified by the raw 
data (Attachment F) and is also illustrated in Figure 2. Some of the 
subjects did not rank the Zaman images in that order, and this accounts 
for the gap between the top of the bars and the total number of 
observations (26). The majority of ranking errors with the Zaman 
imagery resulted from the interchanging of signal-to-noise ratios within 
.one ground sample distance value. For example: 


Ist SNR 3:1 
ond SNR Sel Interchanged 
3rd SNR 5:1 
4th SNR 3:1 
Sth GSD12"' SNR 5:1 
6th GSD12" SNR 3:1 


The bars in Figure 2 represent the mode of the distribution of ranks for 
each individual Zaman image. After the Zaman imagery had been separately 
plotted, the individual placements of the KH-8 photography relative to 
the Zaman imagery were entered. One '"X" represents the placement of the 
KH-8 (SO-369) relative to the simulated Zaman imagery by one photo analyst. 
Similarly one "O'' represents the placement of the KH-8 (2430) by one analyst. 


Table 5 shows the relative rankings of the three KH-8 scenes for 
each film type. The cells in the table show the number of subjects who 
ranked the KH-8 photographs first, second and third when just the three 
scenes on SQ-369 and the three scenes of 2430 were ranked. 


TABLE 5 RANKS OF THE KH-8 PHOTOGRAPHY 


SO 369 
SCENE 
A B C 
First 1 18 7 
Second 7 5 14 
Third 18 3 5 
2430 
A B C 
First 1 20 ) 
Second 5 5 16 


Third 20 £ 5 
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The results show the order of preference as Scene B, Scene C, and 
Scene A and do not account for the apparent shifts in the placement of 
KH-8 photography in the simulated Zaman imagery ranking. 


The data summary presented in Table 3 shows that the rankings 
of the KH-8 images in relation to the simulated images were more 


that the rankings of the simulated images alone. It shows 


that the :1 SNR image more frequently (100 of 156 possibilities) 
_ranked better for intelligence purposes than the KH-8 images. It shows, 
but not unequivocally, that the KH-8 images were judged approximately 
wivalent to the 3:1 SNR an 5:1 SNR images and the 
/3:1 SNR is borderline in equaling the best KH-8 photography. 
Finally it shows that the 12'' GSD images at either SNR were not as 
useful for intelligence purposes as the KH-8 images. It must be 
remembered that these generalized conclusions were derived from scene 
dependent results. For individual scene results one must refer to the 
data shown in Figures 1 and 2. 


The mean ranks assigned the simulated images were in the same 
order regardless of scene or scale: 


Rank 1. GSD SNR 


= 5:1] 
Rank 2. GSD SNR = 3:1 
Rank 3. GSD SNR = 5:1 
Rank 4. GSD SNR = 3:1 
Rank 5. GSD = >» SNR = 5:1 
Rank 6. GSD = 12", SNR = 3:1 


The data also showed that, in general, the differences among the 
simulated images due to differences in GSD were more discriminable than 
the differences due to SNR. 


An alternate method of examining the resulting data is to determine the 
percent incidence of choosing each simulated Zaman image better than KH-8 
photography, as shown in Figure 3 (page 30). For conciseness, both 2430 
and SO-369 film types have been combined as representative of best KH-8 
photography. Similarly, the reduced and contact scale were combined as 
representative of simulated Zaman imagery. An example of interpreting 
the graph is as follows: In Scene B, approximately 86% of th ings 
by photo analysts indicated that the simulated Zaman image of 71 SNR 
was better for intelligence purposes than KH-8. Conversely, 14 percent 
of the rankings by photo analysts indicated that the KH- tter for 
intelligence purposes than the simulated Zaman image fea SNR. If 
an evaluation is to be based on percentage of photo analysts rating each 
zaman image quality level better than KH-8, then this form of data pre- 
sentation is most relevant. From this form of data presentation, one can 
see most vividly that the results are scene dependent, which was previously 
pointed out. 
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TABLE 4A: COMBINED DATA, REDUCED SCALE IMAGES 
SCENE A: CONCRETE PIPE PLANT 


12" KH-8 KH-8 


5:31 Fa S0369 2430 


Note: The number in each cell of the above table represents the number 


of subjects placing each image in the rank position. 
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TABLE 4B: COMBINED DATA, REDUCED SCALE IMAGES 
SCENE B: ENGINEERING TEST CENTER 


12” 12" KH-8 KH-8 


§s1 3:1 50369 2430 


Note: The number in each cell of the above table represents the number 


of subjects placing each image in the rank position, 
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TABLE 4C: COMBINED DATA, REDUCED SCALE IMAGES 
SCENE C; AIRFIELD 


GSD 2” 12" KH-8 KH-8 


SNR 5:1 3:31 se | 3:1 5:1 3st $0369 2430 


Note: The number in each cell of the above table represents the number 


of subjects placing each image in the rank position, 
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TABLE 4D: COMBINED DATA, CONTACT SCALE IMAGES 
SCENE A: CONCRETE PIPE PLANT 


KH-8 KH-8 


$0369 2430 


Note: The number in each cell of the above table represents the number 


of subjects placing each image in the rank position. 
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TABLE 4E: COMBINED DATA, CONTACT SCALE IMAGES 
SCENE B: ENGINEERING TEST CENTER 


12" 12" KH-8 KH-8 


5:1 Sosa $0369 2430 


The number in each cell of the above table represents the number 


of subjects placing each image in the rank position. 
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TABLE 4F; COMBINED DATA, CONTACT SCALE IMAGES 
SCENE C: AIRFIELD 


GSD 12" 12" KH-8 KH-8 


‘SNR 5:1 3:1 S:1 3:1 5:1 3:1 $0369 2430 


Note: The number in each cell of the above table represents the number 


of subjects placing each image in the rank position. 


17 Handle Via 
BY EMAN 
TALENT-KEYHOLE 
TOP F ZAMAN ‘ Control gpateand Jointly 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


Qe 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


Qe 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


Q 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


Q 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


Q 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


Q 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


aia aa aeRO rmhrrlUCcOMlUClC lrCCUClC rCUlCUlClC CTlCcCCUlC rClClClC rClC CCTlUrhTlCUhlClUlUrChCU 
S2s 
=p oO 
we< 
eA8 
ae 
am 
uw 
owt 
FIGURE 2A Scene A: Concrete Pipe =, < 
NUMBER OF SUBJECTS ASSIGNING MODE RANK Plant S) 
TO ae IMAGES AND NUMBER ASSIGNING Reduced Scale m 
N KH-8 P 
RANK TO HOTOGRAPHY X - KH-8 (50-369) 
O - KH-8 (2430) 
Tota! Number of Observations (26) 
2 —_d 
20 
{ 
no 
a Number 
' of 45 cc 
en Subjects san 
N > 
> 
> 10 = 
> = 
0 
oe 0 0 
5 XO X 0 
XQ X X 0 XQ 
XQ X X0 X 0 
X0 X0 XO X 0 X 
XO X0 X 0 XQ X 0 
X0 Q X0 0 X 0 X_0 
~ GSD/SNR 12'/5:1 12731 is 
= 
o2 Rank Position st 2nd 3rd Ath 5th 6th S 
2- oe 
a> 
es KH-8 Photography Placed Relative to Predominant Ranking of Simulated Zaman Imagery oO 
ex 
vy ms 
Sze 
22< 
“< m7 


_. Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 
a aetlUCwrmrlC lrlrlCcrlC rlhlCrlhlUC rhUCUCrrLhCUCUrrlClUCUcrhOlUCUrOrlChUrhlLUrL CULL 


RIA a1pueH i 


AWuior swaysAs jomuog 


STOHAZY-LNS TL NVWSAS 


FIGURE 2-B Scene B: Engineering 
NUMBEROF SUBJECTS ASSIGNING MODE RANK Test-Center 
TO SIMULATED IMAGES AND NUMBER ASSIGNING Reduced Scale 

RANK TO KH-8 PHOTOGRAPHY X - KH-8 (S0-369) 


O - KH-8 (2430) 


Total Number of Observations (26) 


dOl 


Number 
of 15 
Subjects 


ri 
i 
re) 
cC 
“Ti 
I 
Ni 
> 
= 
> 
= 


DKK DK OK DOK OK OK OK OK 
DMOODOOOCO0000 


GSD/SNR 12'Y5:1 12'¥3.1 
Rank Position Ist 2nd 3rd 4th 5th 6th 


KH-8 Photography Placed Relative to Predominant Ranking of Simulated Zaman Imagery 


Oo €LTE-FAE 


SIOHASY-LNS TL NVYWSAG 


Ajyulor swiaysAg jouyu09 
BIA a1pueH 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


aii a aa aT lc aeaetllUcrUrhlUlCUCcrUlUClC rlUlClCclClClCrlClCrllClCOOCrO Ol 
oor 
gaa 
g22 
=p 
mes 
SAD 
o> 
Zim 
ae - 
oa 
2% 

FIGURE 2-€ Scene C: Airfield “= 
NUMBER OF SUBJECTS ASSIGNING MODE RANK Q 
TO SIMULATED IMAGES AND NUMBER ASSIGNING Reduced Scale m 
RANK TO KH-8 PH 
SOE X - KH-B (50-369) 
0 - KH-8 (2430) 
Total Number of Observations (26) 
25 
20 
‘ 
RQ Number 
fo 15 

Cm ! 0 = 

bi 

a Subjects rT 

i) > 

> 

10 =. 
= > 
> < 


wn 
>< o< O< O< OX OS OS OK OS 
PMOMVDOOCMOOCO0O 
i>< >< >< O< D< O< 

(amy ame] om 3 an) 

>< >< >< >< DK OK O< 
MmOIOoOOOooe 


DX >< O< >< 
OOOeo 


Ayyuiof swaysds jonueg 


e1A a1pueH 


iv) w/e. 1172. 

a GSD/SNR 12'/5:1 12'/3:1 By 
2 Rank Position Ist and - 3rd Ath 5th 6th 
3 % 
2 KH-8 Photography Placed Relative to Predominant Ranking of Simulated Zaman Imagery NPIC P-0244 Oo 
* O° 
m 

ag 

= 

oO 

= 

m 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


a ai aici a qa HS ua acriuuatranke a wa a es oe 
gaz 
BOA 
S58 
wes 
BAS 
gP 
am 
L2 
ocd 
2A 
FIGURE 2D Scene A: Concrete Pipe r = 
NUMBER OF SUBJECTS ASSIGNING MODE RANK Plant ° 
TO SIMULATED IMAGES AND NUMBER ASSIGNING Contact Scale m 
RANK TO KH-8 PHOTO 
e PIO SHARDY X - KH-8 (90-369) 
O - KH-8 (2430) 
Total Number of Observations (26) 
a 25 ma | 
20 By 
rri : rn 
+ — 
—~ Number - 
ad 
co ' of 45 = 
ma ” Subjects “Ti 
a! 
= > 
= ‘ = 
> 
Se = 


>< >e OK OK OK OK OK OS OK OS 
DOOODODOO00O 


g GSD/SNR 12/5: 12'73:1 

2 Rank Position Ist 2nd 3rd 4th 5th 6th : 
: 3 2 
2 KH-8 Photography Placed Relative to Predominant Ranking of Simulated Zaman imagery NPIC P-0245 a 
x s) 
m 

< 

=x 

(eo) 

° 

m 


Ajyusor suiayshs josuey 


2A a[pueH 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


nae eee ewe ee et ke ke ke ke a fe 
gue 
ama 
os 
2 
Pra 
c= 
2 fn 
eo 
oi 
= iy 
FIGURE 2-E Scene B: Engineering Test 3g 
NUMBER OF SUBJECTS ASSIGNING MODE RANK Gite 5 
TO te IMAGES AND NUMBER ASSIGNING Contact Scale m 
RANK TO KH-8 PHOTOGRAPHY 
X - KH-8 ($0-369) 
0 - KH-8 (2430) 
Total Number of Observations (26) 
— 25 ~ 
© 
iv ] 
20 
t eri 
— ee 
co Number = 
jas of 15 = 
= Subjects mat 
mn a 
~ > 
> 10 = 
= > 
= = 


>< >< OK OO > Oe 
DODdOOOO00D 


GSD/ SNR 12'/5:1 12'73:1 
Rank Position Ist 2nd 3rd 4th Sth 6th 


KH-8 Photography Placed Relative to Predominant Ranking of Simulated Zaman Imagery NPIC P-0246 


O €LT€-HAd 


STOHASY-LNATVL NWWEAG 


Ayuior swaysAg jorju0g 
BIA ajpueH 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 
[2 a 2 2 2 2 fe FlUlUlCelCclUclUL lL 


BIA ajpuey a 


Ajulof swayshg ponuey 


SJ TOHASY-LNA TL NVWAAS 


FIGURE 2F Scene C: Airfield 
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IV. CONCLUSIONS 


1. Based on the data available in this study, and utilizing 
any reasonable criteria, the 12 inch ground sample distance 
imagery with either of the considered signal-to-noise ratios could 
not duplicate best KH-8 quality. 


2, Based on the criteria of the preference of at least 50 
ercent or the photo analysts, there are several conclusions which 
can be made from an analysis of the data presented. The most 
Significant of these are: 


V, RECOMMENDATION 


This study attempted to evaluate systematically the simulated 
Zaman imagery and it was presumed at the outset that ranking of the 
images would approximately reflect exploitation potential. Although 
this study represents the best data currently available, the varia- 
bility of the rankings clearly indicates the risk inherent in basing 
final system design decisions on the limited data derived solely 
from this study. For this reason, it is recommended that an 
exploitation performance study, that is, one in which PIs would 
respond to test questions on targets with known ground truth, be 
undertaken to complement this effort. The resulting rankings would 
then be based on absolute performance factors rather than subjective 
judgments. The results of such a study should produce more precise 
conclusions than the current subjective judgment study can provide. 
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TABLE Fl: SCENE A 
RAW DATA: RANKING OF REDUCED SAMPLED IMAGERY EVALUATED FIRST 


GSD 12" 12" KBs KH-8 
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TABLE F2: SCENE B | 
RAW DATA: RANKING OF REDUCED SAMPLED IMAGERY EVALUATED FIRST 


GSD 12" 12" KH-8 KH-8 


SNR 5:1 3:1 Bcd 3:1 iat 3:1 S0369 2430 


Sl 2 Lee 3V 8 7/4 4 6 


=X 19 30 64 66 98 96 40 55 
ty 37 82 330 342 744 Ip e 146 259 

X 1.46 2.31 4.92 5.08 7.54 7.38 3.08 4.23 
oO 0.84 0.99 1,07 - 0.75 0.63 0.48 1.33 1.42 


Handle Via 
49 BYEMAN 


TOP SE AMAN rene Control systems Jointly 


n 
wo 
fmt 
<q 
f= 
un 
nN 
On 
oo 
< 
“I 
Q 
nN 
N 
w 
N 


Approved for Release: 2021/04/08 C05104506 


Approved for Release: 2021/04/08 C05104506 


BYEMAN I F ZAMAN 


TALENT-KEYHOLE 
Control Systems Jointly 


BYE-3173 0 


TABLE F3: SCENE C 
RAW DATA: RANKING OF REDUCED SAMPLED IMAGERY EVALUATED FIRST . 


12" KH-8 KH-8 


3:1 S0369 2430 


69 69 95 100 34 31 
100 124 atl 375 697 172 106 107 


2.46 2.92 5.31 5.31 7.51 7.69 2.61 2.39 


1.28 0.997 0.61 0.82 0.46 0.46 1.08 1.60 
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TABLE F4: SCENE A 
RAW DATA: RANKING OF CONTACT SAMPLED IMAGERY EVALUATED FIRST 


| ZY La" KH-8 KH-8 


5:1 3:1 S0369 2430 
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TABLE F5: SCENE B 
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TABLE F6: SCENE C 
RAW DATA: RANKING OF CONTACT SAMPLED IMAGERY EVALUATED FIRST 
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TABLE F8: SCENE B 
RAW DATA: RANKING OF REDUCED SAMPLED IMAGERY EVALUATED SECOND 


bea 12" KH-8 KH-8 


Sil 3:1 S0369 2430 


19 . 28 59 65 93 99 SZ 53 

35 70 293 333 671 759 244 247 
1.46 2.15 4.54 5.00 7.45 7.61 4.00 4.07 
0.74 0.86 1.39 0.78 0.66 0.62 1.66 1.54 


Handle Via 
55 BYEMAN 
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TABLE F9: SCENE C . — 
RAW DATA: RANKING OF REDUCED SAMPLED IMAGERY EVALUATED SECOND 


12" 12"  KH-8  KH-8 


5:1 eee | S0369 =. 2430 


Handle Via 
BYEMAN 


56 
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TABLE F10: SCENE A 


RET RUFF ZAMAN 


BYE-3173 0 


RAW DATA : RANKING OF CONTACT SAMPLED IMAGERY EVALUATED SEOOND 


3.15 
1.23 


4.54 
0.84 


6 
6 
6 
4 
3 
6 
6 
6 


On 


65 
351 


5.00 
1.41 


12" IZ KH-8 KH-8 
StL . 3:1 $0369 2430 


93 102 32 41 

667 802 112 171 
7eL5 7.84 2.46 3.15 
0.36 0.36 1.60 1.79 


Handle Via 

BYEMAN 
TALENT-KEYHOLE 

Control Systems Jointly 
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yEMAN TQ ZAMAN BYE-3173 0 


TALENT-KEYHOLE 
Control Systems Jointly 


TABLE Fll: SCENE B 
RAW DATA : RANKING OF CONTACT SAMPLED IMAGERY EVALUATED SECOND 


iz! 12° KH-8 KH-8 


5:1 3:1 S0369 2430 


29 oF 71 94 98 45 51 

77 261 407 686 742 181 245 
1.77 2.23 4.38 5.46 7.23 7.54 3.46 3.92 
0.97 0.97 0.92 rr 4 0.70 0.49 1.39 1.85 


Handle Via 

BYEMAN 
TALENT-KEYHOLE 

Control Systems Jointly 
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TABLE F12: SCENE C 
RAW DATA : RANKING OF CONTACT SAMPLED IMAGERY EVALUATED SECOND 


GSD 12" 12"  KH-8 — KH-8 

SNR 5:1 3:1 5:1 3:1 5:1 3:1 80369 2430 

S3 3 4 5 6 7 8 | 2 
$10 3 1 6 5 7 8 4 2 

$7 2 1 3 4 5 7 8 6 

S2 if 2 6 5 8 7 4 3 

S1 2 4 5 6 7 8 3 

so 3 4 5 6 7 8 2 7 

S8 3 4 5 6 7 8 2 vt 

S4 2 1 3 4 7 8 5 6 

SS 3 1 5 6 7 8 4 2 

$12 3 4 6 5 8 7 2 1 

$11 5 6 4 3 8 2 1 

S6 3 4 S 8 7 2 1 

$13 4 3 S 6 8 7 2 sf 

EX 37 39 63 68 94 98 41 28 

Lx? 117 149 317 368 688 742 171 100 

X 2.85 3.00 4.85 5.23 7.23 7.54 3.15 2.15 

o 0.95 1.57 0.95 0.97 0.80 0.50 1.79 1.75 

59 yee 
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